SUBDIFFERENTIAL ANALYSIS OF DIFFERENTIAL INCLUSIONS VIA 

DISCRETIZATION 



C.H. JEFFREY PANG 

Abstract. The framework of differential inclusions encompasses modern optimal con- 
^ ^ trol and the calculus of variations. Necessary optimality conditions in the literature identify 

potentially optimal paths, but do not show how to perturb paths to optimality. We first look 
at the corresponding discretized inclusions, estimating the subdifferential dependence of 
the optimal value in terms of the endpoints of the feasible paths. Our approach is to first es- 
timate the coderivative of the reachable map. The discretized (nonsmooth) Euler-Lagrange 
and transversality conditions follow as a corollary. We obtain corresponding results for 
differential inclusions by passing discretized inclusions to the limit. 
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1. Introduction 

The subject of this paper is the analysis of discretized differential inclusions by calcu- 
lating the coderivatives of the discretized reachable map. We then pass these results to the 
limit to obtain results on differential inclusions. We say that 5 is a set-valued map or a 
multifunction, denoted hyS:X^Y,if S{x) C Y for all xeX.ForF : [0, T] x K" ^ R" 
and C C M" X R", consider the differential inclusion: 

min (p(x(Q),x(T)) (1.1) 

x(-)€AC{[0,T].TSi") 

S.t. x{t) eF{t,x{t)) for? e [0,r] a.e. 
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Here, AC( [0,r],R") is the set of absolutely continuous functions x : [Q,T] W. The 
constraint 

{x{Q),x{T))eCcM"xM." 

is sometimes included, but this constraint can be easily incorporated into the objective 
function (p. More details on differential inclusions can be obtained in the texts I AC841 
IAF90I ICla83l IMor06l ISmi02l IVinOOI . As is popularized in these texts, the differential 
inclusion framework ( 11.11 ) encompasses optimal control and the calculus of variations. 

In order to optimize ( 11.11 ). much attention has focused on necessary optimality condi- 
tions for a path x{-). Such research were undertaken in the last few decades by Clarke, 
Loewen, Rockafellar, loffe, Vinter, Mordukhovich, Kaskosz and Lojasiewicz, Milyutin, 
Smirnov, Zheng, Zhu and others, building on results in the calculus of variations and op- 
timal control. For a history of the development of the necessary optimality conditions, we 
refer to the previously mentioned texts. The following conditions are currently understood 
as useful necessary optimality conditions for a feasible path x(-) of (11.11 ): 

(TC) (Transversality Condition) 

i~piO),piT))ed(p{x{0)AT)) 
(EL) (Euler-Lagrange Condition) 

p'{t) G -coD*F(t,x{t) \x'{t))[p{t)) forf G [Q,T] a.e.. 
(WP) (Weierstrass-Pontryagin Maximum Principle) 

{-p{t),v-x'{t)) <OforallvGF(r,i(r)),rG [0,r] a.e.. 

While such necessary conditions are helpful in finding candidates for a minimizing path, 
the deficiency in such necessary conditions is that they do not give an indication on how 
to perturb a feasible path to optimality. As a first step, we study the discrete inclusions 
corresponding to the differential inclusion and calculate the dependence of the differential 
inclusion on its initial point. 

Define the reachable map (or attainable map) : M" =^ M" by 

/;(xo) := {y:3x(.)GAC([0,r],R«)s.t. (1.2) 
x'{t) eF{t,x{t)) forf G [0,T] a.e., 
x{Q) —xo andx(r) —y}. 

In order to study dl.ll i. we study 

f{x) := min (p{x,y) (1.3) 
s.t. y G R{x) 

We study (11.3b under the broader framework of marginal functions. For a set- valued map 
G :X and a function (j? : X x F — > R, the marginal function / : X — > M is 

fix):^mf{(p{x,y):yeG{x)}. (1.4) 

One can view the value x as a parameter of an optimization problem in terms of y. A well 
studied example of a set-valued map G is the map G : M" =^ R™ defined by 

G{x) - {y\yeF{x) + [{0}xR"y]}, 

where mi + m2 — m and F : R" — > M'" is smooth 
— {y I yi — Fi{x) for 1 < / < mi and yi < Fi{x) for mi + 1 <i <m}. 

The sensitivity analysis of marginal functions can be analyzed with tools of set-valued 
analysis. We denote the composition 82° Si : X of set-valued maps Si :X and 
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^2 : F =^ Z in the usual way by 

52o5i(x)= y S2{y). 

yeSiix) 

Denote the epigraphical mapping of (p and f hy E(p : X x Y ^ M. and Ef :X ^M. respec- 
tively. Then E(p and Ef satisfy the relation 

Efix)=E^oGix), (1.5) 

where G : X xY is defined by G{x) — {x} x G{x). The relationship (ll.5l l and a set- 
valued chain rule can be used to express differentiability properties of / in terms of the 
coderivatives of G and (p. 

1.1. Contributions of this paper. In this work, we focus on the subdifferential analysis of 
the discretized differential inclusion problem by finding d f{x), where / is the discretized 
analogue of (11.3b . Our approach is to look at the marginal function framework and calculate 
the coderivatives of the reachable map R{-). The coderivative of the reachable map gives 
new insight on the Euler-Lagrange Condition (EL). We also study the limitations of a 
discrete analogue of the Weierstrass-Pontryagin Maximum Principle (WP). 

For a set valued map 5 : R" =t M'" between finite dimensional spaces, I Panl lal recently 
established that the convexified limiting coderivative characterizes the set of positively 
homogeneous maps that are generalized derivatives of S as defined in OPanl Ibl . We will 
recall on this relation in Section|2] limiting our analysis to the finite dimensional case. By 
making use of this result, we can obtain the convexified limiting coderivative of /?(•) by 
passing a sequence of discrete problems to the limit. The marginal function framework 
allows us to calculate the subdifferential dependence of the differential inclusion in terms 
of its initial value. 

1.2. Outline. In Section|2l we recall standard definitions in variational analysis and some 
results in BPanl lal that will be used in the later part of the paper. In Section |3] we recall 
chain rules for coderivatives, and show how these results can be easily extended for the 
convexified limiting coderivative. In Section|4] we study the discretized differential inclu- 
sion problem. Finally, in Section|5] we study the continuous inclusion problem by passing 
the discretized problems in Section |4] to the limit, and find formulas for the convexified 
limiting coderivative of the reachable map. 

2. Preliminaries and notation 

This section recalls some standard definitions in variational analysis and some other re- 
sults in fPanl la] that will be used in the remainder of this paper The texts IIRW98llMor06l 
contain many standard definitions in variational analysis, like inner and outer semicontinu- 
ity (isc and osc) and the Pompieu-Hausdorff distance d(-, •). We highlight some of defini- 
tions used most often in this paper We denote the set {1,2, . . . ,A^} by 1,A^. For set-valued 
maps Hi : M" ^ M'", / = 1 , 2, we let H\ C H2 denote H\ (x) C H2 {x) for all x, or equivalently 
Graph(i/i) C Graph(i/2)- 

We recall the definition of coderivatives. 

Definition 2.1. (Normal cones) For a set C C M", the regular normal cone at x is defined 

as 

A?c(i) := {y \ {y,x-x) <o(l|x-x||) for all jc G C}. 
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The limiting {or Mordukhovich) normal cone Nc{x) is defined as limsup^_^^Nc{x), or as 

c 

Nc{x) = {y I there exists x,- x, y,- £ Nc{xi) such that y,- — y}. 

Definition 2.2. (Coderivatives) For a set-valued map 5 : M" ^ M"' locally closed at {x,y) € 
Graph(5), the regular coderivative at {x,y), denoted by D*S{x \ y) : W" ^ M", is defined 
by 

V G D*S{X I y)(M) ^ (V, -m) e ^Graph(S)(^j) 

^ ((v,-M),(x,3/)-(ij)) <o(|l(x,3;)-(xj)||) 

for all eGraph(5). 

The limiting (or Mordukhovich) coderivative at (i,}') G Graph(5) is denoted by D*5(x | y) : 
M" ^ R" and is defined by 

V e D*S{x I y)(M) 4::^ (v, -m) e A^Graph(5)(^,3')- 

The convexified limiting coderivative c6D*S{x \ y) : M"' =t M" is defined in the natural 
manner. 

We recall the definition of subdifferentials. 

Definition 2.3. (Subdifferentials) Consider a function / : R" M U {°°} at a point x where 
f{x) is finite. Then the limiting (or Mordukhovich) subdifferential dfix), horizon subdif- 
ferential d°°f(x) and the Clarke ( or generalized) subdifferential dcf{x) are defined respec- 
tively by 

dm := {v|(v,-l)GA?ep,(/)(-^>/(-^))} 
= D*Ef{x\f{x))il), 
d-f{x) {v|(v,0)eA^epi(/)(^,/W)} 
= D*Ef{x\m)(Q), 
and dcf{x) '■= codf{x) 

= coD*Ef{x\f{x)){l). 

The hmiting and Clarke subdifferentials coincide with the usual definition of subdiffer- 
ential when / is convex. The subdifferential df{x) gives important information on how / 
varies with respect to x when close to x. 

We now recall the definition of generalized derivatives of set-valued maps in the sense 
of OPanl Ibl . Let B denote the unit ball in the appropriate space. 

Definition 2.4. llPanllbl (Generalized differentiability) Let 5 : R" =t R'" be such that S 
is locally closed at {x,y) G Graph(5'), and let // : R" =t R'" be a positively homogeneous 
map. The map S is pseudo strictly H-differentiable at {x,y) if for any 5 > 0, there are 
neighborhoods Ug of x and V5 of y such that 

S{x)r\V5ClS{x)+H{x~x') + 8\\x-x\\Mfora\\x,x' e t/5. 

We shall also write 

{H + 5){w) ■.^H{w) + 5\\w\\M 

to reduce notation. The map S has the Aubin property (or the pseudo-Lipschitz property) 
with modulus fc > if 5 is pseudo strictly //-differentiable for some H defined by H{w) = 
fc|| w||B. The graphical modulus is the infimum of all such K, and is denoted by lip S{x \ y). 

We now recall the definition of prefans and the generalized derivative set Jf{D). 
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Definition 2.5. floMI (Prefans) We say that // : M" =t K'" is a prefan if 

(1) H{p) is nonempty, convex and compact for all p G M", 

(2) H is positively homogeneous, and 

(3) \\H\\+ := sup||„||<i sup,^H{w) Ikll is finite. 

Definition 2.6. OPanllal (Generalized derivative set) Let D : K™ =^ M" be a positively 
homogeneous, osc set- valued map s.t. + is finite. We define the generalized derivative 
set by 

Jf'(D) := {// : K" =t M'" : // is a prefan, 

and for all p e M"\{0} and u e M'", 
min {u,y) < min {v,p)}. 

yeH{p) i'Gco£)(m) 

The Aubin criterion characterizes the graphical modulus lip5'(i | y) in terms of graphical 
derivatives (which are in turn defined in terms of tangent cones), while the Mordukhovich 
criterion characterizes lip5(x | y) in terms of coderivatives. Theorem l2.7l and Lemma 1278] 
below characterize the set of possible generalized derivatives at a point {x,y) G Graph(5), 
and can be seen as a generalization of the Mordukhovich criterion. While the proof in 
llPanl lal makes heavy use of graphical derivatives and recent work in |DQZ06 | (who in 
turn acknowledged Frankowska's contribution), the main results in finite dimensions have 
an appealing formulation in terms of coderivatives. 

Tlieorem 2.7. llPanI lal ( Characterization of generalized derivatives) Let S :W ^ M'" be 

locally closed at {x,y) G Graph(5) and let H :W ^ W" be a prefan. Then S is pseudo 
strictly H -differentiable at {x,y) if and only ifH G ,^{^D*S{x \ y)). (Note that ,^{p*S{x \ 
y))=.J^{coD*S{x\y)).) 

Lemma 2.8. llPanI lal (Convexified coderivatives and generalized derivatives) Suppose 
Di : W" ^ M" are positively homogeneous, osc, and ||-D,||^ are finite for i — 1,2. Then the 
following strict reverse inclusion properties hold: 

(1) Jff{Di) D ,^{D2) iffcoDi C C0D2. 

(2) M'{Di) D ^(D2) ijfcoDi C C0D2. 

(3) -^{Di) = ■3^{D2) iffcoDi = C0D2. 

These results show that the convexified limiting coderivative coD*5(-|-)(-) is an effec- 
tive tool for studying the generalized derivatives of set-valued maps, just like the way 
the Clarke subdifferential is useful for studying the generalized differentiability of single- 
valued maps. 

We recall the definition of inner semicompactness that will be used in the chain rules 
for set- valued maps in this paper. 

Definition 2.9. (Inner semicompactness) We say that 5 : R" R'" is inner semicompact 
at a: G dom(5') if for every sequence Xk — !• x, there is a sequence yk G S{xk) that contains a 
convergent subsequence as A; — > 00. 

In finite dimensions, if there is a neighborhood U of x and a bounded neighborhood V 
such that S{U) C V, then S is inner semicompact at x. 

Finally, we recall the definition of regularity and a straightforward consequence of 
graphical regularity. 

Definition 2.10. (Regularity) We say that C C M" is Clarke regular at x G C if C is locally 
closed at x and Nc{x) = Nc{x). We say that 5 : M" ^ R'" is graphically regular at {x,y) G 
Graph(5) if Graph(5) is Clarke regular at {x,y). 
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Fact 2.11. (Convexified limiting coderivatives under graph regularity) If S : R-" ^ M™ 
is graphically regular at {x,y) G Graph(5), then Graph(D*5(i | y)) = Graph(D*5(x | y)). 
Furthermore, Graph(Z)*5(i | y)) is a convex cone, and we have coD*S{x \ y) = D*S{x \ y). 

3. Calculus of convexified limiting coderivatives 

In this section, we discuss how the chain rule for the convexified limiting coderivatives 
can be obtained directly from the coderivative chain rules, removing parts irrelevant in the 
finite dimensional case. In Lemma [331 we deduce that the convexified limiting coderiva- 
tive, together with the limiting subdifferential, are sufficient in calculating the Clarke sub- 
differential of marginal functions. This suggests that the convexified limiting coderivative 
of the reachable map as calculated in|5] while not as precise as the coderivative, can be a 
satisfactory conclusion. 

We first write down the chain rule for finite dimensional coderivatives based on fMor06l 
Theorem 3.13] and I.RW98. Theorem 10.37]. The formulas i3.2i and (I3.3I) for convexified 
Umiting coderivatives are straightforward. 

Theorem 3.1. (Coderivative chain rule) Let G : R' ^ W", F : M'" =t M", z G o G){x), 
and 

S{x,z) := G{x)nF-\z) ^ {y e G{x) : z G F{y)}. 
The following assertions hold: 

(1) Giveny £ S{x,z), assume that S is inner semicontinuous at {x,z,y), that the graphs 
of F and G are locally closed around the points {y,z) and [x^y) respectively, and 
that the qualification condition 

D*F{y I z)(0) n -D*G-\y \ i)(0) - {0} (3.1) 

is fulfilled. Then one has 

D*{FoG){x\z)cD*G{x\y)oD*F{y\z), 

which in turn implies 

coD*{FoG){x I z) C coD*G{x \ y)oD*F{y \ z). (3.2) 

(2) Assume that S is inner semicompact at {x,z), that G and F^^ are closed-graph 
whenever x is near x and z is near z, respectively, and that ( 13. Il l holds for every 
y G S{x,z)- Then 

D*{FoG){x\z) C y D*G{x\y)oD*F{y\z), 

yeS(x,z) 

which in turn implies 

coD*(FoG)(i|z) ceo U coD*G{x\y)oD*F{y\z). (3.3) 

(3) IfS is locally bounded at {x,z), ( 13. Il l holds for every y G S{x,z), and F and G are 
both graph convex ( i.e., have convex graphs), then F oG is also graph convex, and 

D* (F oG)ix\z)^D*G{x\y)o D*F {y \ z) for any yeS{x,z). 

The formula ( 13.31 ) is not any stronger if its RHS is replaced by 

CO U D*G{x\y)oD*Fiy\-z), 
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since this formula is equal to the RHS of (13.3b . Therefore, to find the convexified limiting 
coderivative coD*{F oG){x\ z), the convexified limiting coderivative of G, i.e., coD*G, is 
sufficient. We explore the possibilities if we had relaxed the formulas ( I3.2l i and ( 13.31 ) by 
replacing the relevant formulas with coD*G{x \ y) ocoD*F{y \ z) instead. 

Example 3.2. (Tightness of chain rules) Consider the set-valued maps G, : M ^ M, / = 
1 , 2, 3 and F : K =^ R defined by 

Gi X = I 

[{-oo,-x]Ll[x,oo) ifx>0, 

G2{x) = [min(0,x),oo), 
G3(x) = [max(x/2,x),oo), 
andF{x) = {-x}U{x}. 

As illustrated in Table [T] we have 

coZJ*(f oGi)(0 I 0) =coD*Gi(0 | 0)oD*F(0 | 0) C coZ)*Gi(0 | 0)ocoD*F(0 | 0), 
coD*(Fo G2)(0 I 0) C coZ)*G2(0 | 0)oD*F{0 \ 0) = co£)*G2(0 | 0) ocoD*F(0 | 0), 
and coD*(F oG3)(0 | 0) C co£)*G3(0 | 0)oD*F{0 \ 0) C coD*G3(0 | 0) ocoD*F(0 | 0). 

The following general principle in the optimization of marginal functions will be used 
later. We take this result from |Mor06, Theorem 3.38]. 

Lemma 3.3. ( Subdijferential of marginal functions) For the marginal function d 1 .41) . define 
the argminimum mapping by 

M(x):={yeG(x)|(p(x,y)=/(x)}. 

The following hold: 

(1) Given y G M{x), assume that M is inner semicontinuous at {x,y), that ^{x,y) is 
l.s.c. around {x,y), and that Grwph^G) is locally closed at {x,y). Suppose also that 
the qualification condition 

d'-(p{x,y) n -A^Graph(G)(-^ J) = {0} (3.4) 
is satisfied. Then one has the inclusion 

df{x) C U [x*+D*G{x\y){y*)]. (3.5) 

anddcfix) C CO |J [x* +coD*G(i | 

{x* ,y-')ed((>(x,y) 

(2) Assume that M is inner semicompact at x, that G is closed-graph and (p is l.s.c. on 
Graph(G) whenever x is near x, and that the other assumptions in (1) are satisfied 
for every y G Mix). Then one has analogs of inclusion ( 13.51 ), where the sets on the 
right-hand sides are replaced by their unions over y G M(x). 

(3) Assume that M is locally bounded at x, ( I3.4l l is satisfied for every y G M{x), G is 
graph-convex and (p is convex. Then f is convex, and 

dfix) = {x* +D*G{x I y){y*) \ (x*,/) G d<p{x,y)} 
for any y G M{x). 
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/= 1 






P..G3 



FoGi 





DF(OIO) 



D*F{0 I 0) 




DG|(()IO) 



D'F(OIO) 



D'F(OIO) 





DG,(()I()) 



D*G,(0 I 0) 



coD*(f oG,)(0 |0) 



coD*G, (0 I Q)oD*F{Q \ 0) 



coD*G, (0 I 0) ocoD*f (0 I 0) 



Table 1 . Possible scenarios in chain rule of set-valued maps from Ex- 
ample [521 



Proof. Cases (1) and (2) are exactly the statement of IIMor06l Theorem 3.38], and we 
prove only (3) from Theorem [03). Consider the map G : R" ^ M" x R™ defined by 
G(x) = {x} X G(x). The coderivative D*G{x \ {x,y)) : W x W" =t R" is easily evaluated to 
be 



D*G{x I {x,y)) {p,q) ^p + D*G{x \ yM- 
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Noting that Ef = E^o G, the constraint qualification we need to check in Theorem |3.1f 3) 

is 

I f{x))iO)n-D*G-'{{xj)\x)iO) = {0}. (3.6) 
Note that d'"(p{x,y) = D*E^{{x,y) \ /(x))(0). Now, {p,q) G D*G-^{{x,y) \ jc)(0) if and 
only if ip,q,0) £ A^Graph(G-i)(^'->''-^)' which is in turn equivalent to {0,p,q) &Nc,^p^^^G]i^'^J) 
We see that Graph(G) is the image of a linear map of Graph(G) and use a rule of normal 
cones on linear maps in IIRW98I Theorem 6.43] to obtain 

^Gmph(G)(-^'-^'3') = {(m,vv,v) I (m + w,v) GA?Gmph(G)(^J)}• 
Thus (0,/?,^) GA^Graph(G)(-^'-^'3') iff eA^Graph(G)(-^ J)- Therefore (jlS is equivalent to 
(I3.4l i. We then apply Theorem l3.U 3) to get 

dm = D*Ef{x\f{x)){\) 

= D*{E^oG){x\f{x)){\). 

Then for any y e M(i), 

df{x) - D*G{x I {x,y)) oD*E^{{x,y) \ f{x)){i) 

= D*G{x\ix,y)){Mxj)) 

= {x*+D*G{x I y){y*) I e dcpixj)}. 

□ 

We remark that IIRW981 Section lOH] and fMor06', Section 3.2] contain other coderiva- 
tive calculus rules that can be easily extended for the convexified limiting coderivative. As 
we have remarked after Theorem l3.1l the convexified limiting coderivative of G in Lemma 
I3.3l is sufficient for obtaining the Clarke subdifferential of /. 

Remark 3.4. (Alternative view of marginal functions) A different view useful for later 
discussions is to consider 

min (p{x,y) 

s.t. e Graph(G). 

As is well known in nonlinear programming, if the point {x, y) is optimal, then G d(p{x,y) + 
A^Graph(G)(-^;3')- Recall that through the definition of coderivatives, A^Giaph(G)(^;3') is related 
to Graph(D*G(i | y)) by a linear transformation. 

4. Subdifferential analysis of discretized inclusions 

In this section, we consider the discretized inclusion and calculate the coderivatives of 
its reachable map. One can then obtain the subdifferential dependence of the differen- 
tial inclusion in terms of its initial conditions. We can then obtain a necessary optimal- 
ity condition of the discretized inclusion similar to the Euler-Lagrange and Transversality 
conditions. Finally, we discuss the limitations of obtaining a discretized version of the 
Weierstrass-Pontryagin maximum principle. 

We consider the following discrete inclusion as the analogue to the differential inclusion 
CD: 

min (p{xo,xn) (4.1) 

xi,eM" for keO.N 

S.t. Xkexk-1 + {At)F{{k-l){At),Xk-i). 
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Here, At = T /N. The inclusion systems above can be further modified to one defined in 
terms of the reachable map. The discretized version of the reachable map Rn : M" =t M" 
can be defined by 



Rf^ixo) = {jCA,: Bx^. e M" for/t= 1,A^- 1 s.t. (4.2) 
Xk exi_i + (Af)F((yt- l)(Af),Xi_i) foralU^l^V}. 
Then (14.1b can be rewritten as 

min (p{xq,xn) (4.3) 
s.t. XN eRN(xQ) cM". 

Theorem 4.1. ( Coderivatives of discretized reachable map) Recall the map R^^ : K." ^ M" 
as defined in (|43]l. Let At /N, and define F^.n : M" =^ K" and Mk,N : M" =^ M" by 

FkA-)-^F{k{At),-) and Mk.N{x) := x+ {At)Fk^N{x). (4.4) 

Note that Rn = Mn-\,n°Mn-2.n ° ■ ■ ■ °Mo!\i. Assume that F^^ locally Lipschitz and for 
all X, k and N, -fit,A'(") '■s locally bounded at x, i.e., there exists a neighborhood U ofx and 
finite R such that F^ n^x') C RMfor all x' € U. 

(1) For xn G R{xq), the coderivative ofRjsi : M" ^ M" satisfies 

D*Rn{xo I Xn) 

C U P*Mo^n{xo I ii ) o ■ ■ ■ o D*Mn-un{xn-i I xnI (4.5) 

(■''-■ }f=o 

where 

S^N = {{^i};^o • X-k € Mk^i N{xk-i) for all k £ 1,N, xq = xq andxN ~ xn} ■ (4.6) 

(2) If in addition F^Ni') ore all graph convex, then 

D*Rn{xo I Xn) = Z)*Mo,iv(io I -^i) o ■ • ■oD*Mn-i,n{xn-i I %) 

for any {xijf^Q G ^n- 

(3) Consider the conditions: 

(a) poeD*RN{xo\xN){pN) 

(b) There are {xi}f^Q G {Pij/^o ■^mc/z f/zaf /?o = /5o, Pn ~ pN cind 
Pk-Pk-l g -D*Fk-i^N (xk-i I {pk)forallkeXN. (4.7) 



Af ' V Af 

Wfe have (a) implies (b), and in the case where each Fi^ n{') is graph convex for all k G 
0, (A^ — 1 ), the converse holds as well. 

Proof. For (1), the case where N ~2 follows directly from Theorem I3.1f 2). The local 
Lipschitz continuity of ^i,Af( ) implies that the graph of F/^ Ni') is closed. The local bound- 
edness of F/^^n ensures that 5'(-, •) in Theorem 13. ir 2) is inner semicompact, and the local 
Lipschitz continuity implies the constraint qualification in ( 13.11 ) holds. The case for general 

is easily deduced from the case where N ~ 2. For (2), we follow the similar steps and 
apply Theorem l3.ir 3). 

To prove that (3a) implies (3b), let G^^.^n ^ : R" =t M" the formula as marked in ( 14.51 ). 

For Pn,Pq G M", we have po G Gj^jiv (pn) if and only if there exists some {pi}f^Q such 
that Po — Po, Pn — Pn and 

Pk-i^D*Mu-i{xk-\ \xk)iPk)forallke'pV, (4.8) 
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From the definition of M^^i^^ and calculus rules for coderivatives in MRW98I Section lOH], 
we have 

D*Mk-x,N{h-\ I =1+ {At)D*Fk_i,N (^^k-i I ^(ii -i^-i)) . (4.9) 
The formula ( 14.71 ) follows easily from (1). The converse holds due to (2). □ 

Putting together the previous results, we have the following necessary optimality con- 
dition for the discrete inclusion problem. 

Theorem 4.2. (Subdijferential analysis of discrete inclusions) For the discrete inclusion 
(14. Il l, suppose F (t , •) is Lipschitz and for each t, there is some b(t) <°° such that F{t,x) C 
b{t)Mfor all x. Define Fk,N : K" =t R" and M^^f^ : R« =^ M" as in (gUi, R^-.W ^ M" by 
and f -.W ^m.by 

f{xo) := min (p{xo,xn) 

s.t. XN e Rn{xq) cM". 

Suppose (p(-, •) is Isc. Then 

df{xo) C U U*+D*G^,_^nJxq I xnW) I (x*,/) e d(p{xo,XN)}, 

{^,}Jlo e ■'^n,xn e«A,(xo) 

(fl(xo,XN) =f{xo) 

where G,~ xn :W ^ M" and '^re defined as in ( 14.51 ) and ( 14. 6t . // in addition all the 
Fk,N{') ^""^ (ill graph convex and (p{-,-) is convex, we have 

df{xo) = {x* +I>*G|~.}«^(xo I XN)iy*) \ {x*,y*) G d(p{xo,XN)} 

for any {i,}^o ^ ■^N s.t. /(xq) = (p{xo,xn). 
In particular, a necessary condition for the optimality of the path {x, }^o ^ '^N is the 
existence of {pi}f^Q such that 

(1) {-P0,Pn) e d(p{xQ,XM), and 

(2) M^G-D*F,_,,„(i,_i I l^{xk-Xk^i)){pk)forallkeT;N. 

Proof. Apply Theorem l4.1l and Lemma |33] □ 

Condition (1) in Theorem 14.21 is the discrete analogue of the Transversality Condition 
(TC), while condition (2) is the analogue of the Euler-Lagrange condition (EL). 

Finally, we make a remark on the Weierstrass-Pontryagin Maximum Principle (WP). 
Before we do so, we recall that for F : [0, T] x M" ^ M", the reachable map of the relaxed 
differential inclusion is defined by 

Rcof{xo) {y:3x{-)eAC{[Q,T],R")s.t. 

x\t) ecoF{t,x{t)) forf e [0,T] a.e., 

x(0) —XQ andx(r) =y}. 

It is well known that under mild conditions, we have clR{x) — Rcof{x) for all x e W. 

Remark 4.3. (Discrete analogue of the Weierstrass-Pontryagin Maximum Principle) Recall 
the chain rule for set- valued maps F :M." ^ M" and G : M" =^ M" as presented in Theorem 
13.11 If the conclusion of the chain rule had been that for all r G R", 

D*{FoG){x\z){r) (4.10) 

C U {coD*G(x-|y)(^)|^GcoD*F(x-|y)(r),(^,y-y)<OforaliyGG(x)}, 

yeF-i{z)nG(x) 
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then we can repeatedly apply this chain rule like in Theorem l4.1l so that under the condi- 
tions of Theorem 14. II po £ D*Rn{xo\xn){pn) implies that there are {xi}f^Q and {pi}f^Q 
such that 

xo=xo,xn=xn, po = Po, Pn = Pn, (4.11a) 
P^'P'-' e -D*F,_i^N (xk-i I -^(xk-x,_i)] {pk) (4.11b) 



At V ^ ^ 

for all k £ Tj7, 

and ^-p*:,v-^(i;t-Xi-i)^ <0 (4.11c) 

for all V G F/^-LNixk-i) and k e 1,A^. 

Such a formula would be appealing because (I4.11bl i corresponds to the Euler-Lagrange 
Condition (EL) and ( I4.11cl i corresponds to the Weierstrass-Pontryagin Maximum Principle 
(WP). However, ( 14.10b is not true in general. Consider the maps G : R ^ R and / : R ^ K 
defined by 

G{x) := [x+l,x + 2]U[x-2,x-\], 
and/(jc) := -|x-0.5|. 

Then/oG(0) = [-2.5, -0.5], and /-^ (-0.5) n G(0) = {1}. We can calculate that 

D*G(0|1)(1) = {1}, 

D7(l|-0.5)(-l) = {l}, 

and D*(/oG)(0|-0.5)(-l) = {l}. 

However, since we do not have(l, 1 — v) < for all v G G(0) = [1,2] U [—2,-1], the right 
hand side of (14.10b is empty, showing us that ( 14.10b cannot be true. 

In the case where Fi^ n ■ R" =^ R" are convex-valued (so that we are considering the 
relaxed differential inclusion), it is an easy exercise that provided Fj^ n is continuous, then 
(I4.11bb is equivalent to 

In addition to the fact that flt-i,Af(ii-i) is convex, ( I4.11cb follows easily. 

5. SUBDIFFERENTIAL ANALYSIS OF DIFFERENTIAL INCLUSIONS 

In this section, we make use of the work in Section|4]to calculate estimates of the con- 
vexified limiting coderivative of the (continuous) reachable map, and explain how this new 
formula gives a new way to interpret the Euler-Lagrange and Transversality conditions. 

We first simplify the notation. Define ^{x,y) to be the set of feasible paths with end 
points X and y, i.e., 

:= {x(.)|x(-)eAC([0,r],R«),x(0)=x,x(r)=y, (5.1) 
andjc'(f) €F{t,x{t)) forf G [OJ] a.e.}. 

Define H : R" x R" x R« =^ R" by 

n(x,y,v) {M|3x(.)G^(x,y),/,(.)GAC([0,r],R") 
s.t. ^(O) — u, p{T) ~ V and 

p'{t) G -coD*F{t,xit) \x'it)){p{t)) forte [0,T] a.e.}. 
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Here, coD*F{t,x{t) \ x'{t)) : M" ^ W is to be understood as coD*F,{x{t) \ x'{t)) : M" =t M", 
where iv(-) ^ F{t,-). Corresponding to n{x,y,v) is its discretized version: 

YlN{x,y, v) 

:= |m I 3{x,}^o, {/5,}^o s.t. xo =x,xn= y, po = u,pN = v, 

■^{xk-Xk^i) eF({k-l){At),xi,_i) for all fee 1,A^, and 

^(w-W-i) e -D*Fk-i^N {xk-\ I foralUelVv|. 

We make the following conjecture. 

Conjecture 5.1. (Upper estimate of discretized coderivative of reachable map) For the 
reachable map : M" =t M" defined in (11.2b , the convexified coderivative cdD*R{x \ y) 
satisfies 

D*R{x\y)iv) C {u:3x{-)e^{x,y),p{-)eAC{[0,T],R")s.t. (5.2) 
p'{t)e^coD:F{tXt) \x'it)){pit)), 
PQ — u and pt — v} far all v €zM"}. 

Remark 5.2. (Consequence of Conjecture 15. Il l Consider the problem 

min (p(x,y) 

s.t. (x,y) e Graph(7?). 

Recall the discussion in Remark \3A\ Provided i5.2i holds, if the point {x,y) is optimal, 
then Oe d(p{x,y) +Ncraph{R){x,y)- We have 

d(p{x,y)+Nc,.^pk{R){x,y) ^ d(p{x,y) + LGi-aph{D*R{x,y)) 

C d(p{x,y)+LGmph{coD*R{x\y)), 

where L : R" x K" — > R" x R" is the linear map represented by the matrix q ^ . Unrolling 

the definition of D*R{x \ y) gives the following optimality condition: If {x^y) is optimal, 
then there are paths x{-),p{-) e AC([0, r],R") such that x{-) is feasible for the differential 
inclusion, x{0) =x,x{T) —y, and satisfies the Transversality condition (TC) and the Euler- 
Lagrange condition (EL). 

We will prove the following weaker result instead: 

coD*R{x\y){v) C co{M:3x(.)e^(x,y),/7(.)eAC([0,r],R")s.t. (5.3) 

p'(f)G-coD:F(f,x(f) |x'(f))(p(f)), 
po = u and pj — v} for all v £ R" . 
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Our strategy is to prove the following three inclusions: 

c6D*R{x\y) C H U U D*Riix\y), (5.4a) 



S>0 



fjcoU U D*Ri{x\y){v) C n^sU U nKx.y.v), (5.4b) 



S>0 



iVeN !>Wx£Bg(.v) 



and Pl'^^U U n,(jc,y,v) C con(x,y,v), 



(5.4c) 



N€N i>N xeBgi-i) 



where ( I5.4bl ) and ( I5.4cl ) hold for all v e M". Conditions for D*Ri{x \ y){v) C Ylps{x,y,v), 
which addresses ( I5.4bb . were discussed in Theorem l4.1l The same steps used to prove that 
( I5.4bb and ( I5.4cl ) hold for all v G M" yield the following stronger statements: For all v € R", 

HclU U D*R,{x\y){v) C H'^lU U nKx.y.v), 



andflclU U n,(x,y,v) C n(x,y,v). 



NeN i>N xeBg(x 
ye*g(y 



Notice that if (I5.4al l were strengthened to be 



D*R{x\y)ci U D*Ri{x\y) 



NeN i>N xeBg{x) 
.veBg(f) 

instead, then piecing the last three formulas together gives ( I5.2l l. We continue with some 
lemmas. 

Lemma 5.3. (Coderivatives around {x,y)) Let 5 > 0, and 5 : M" ^ M'" be a closed set- 
valued map. Suppose H :W ^ M'" is a prefan such that 

( \ 



CO U D*S{x\y) 



xmgix) 

\ y^Bgiy) 



) 



Let 5' := min(g, )■ Then 

S{x')nMs/2{y) C S{x")+H{x' ^x")forallx',x" G Ms>{x). 

Proof. For any xeMg (x) and y eMg {y), we have H G JifiD*S{x \y)). Choose any > 0. 
There exists some ex,y.e > such that 

S{x')nMs^^,g(y)cS{x") + {H+e){x'-x") forallx',x" GB£,.,,,e(x). 

For each x G ©^(x), we can find a finite number of elements in Bg(3'), say {yjYj^i, such 
that Msiy) C uj^jB£,.^.g(y). Letting e^.g := mmj^jjie^^y.^e), we have 

S(x')r\Msiy) C S{x") + {H + e){x'-x") for all x' ,x" G B^^g [x). 

For any line segment [x',x"] in lS>s{x), we can find finitely many x in lS>g{x), say {xk}f^i 
such that [x',x"] C yjf^^M^^^ ^ (xj^). We can break up the Une segment [x',x"] to a union of 
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line segments uj^J so that line up in that order, each is inside 

some Mg^ ^ (x^^), ii =x' and iy = x" . Then 

S{xj)nMs{y) C Sixj+i) + {H+e){xj~Xj+i) 
^[S{xj)nMs{y)] + {H+e){xi-xj) c S{xj+i) + {H+e){xi-Xj+i). 
We write K = to simplify notation. This gives 

[Sixj) + (//+ 0)(ii -i;)] nB5_(^+e)|y_,„|(y) c [Sixj)n-Bsm + {H+e){x, -xj) 

C S{xj+i) + {H+e){xx-Xj+i), 

which implies 

[S{xj) + (//+ 0)(ii -i,)] nB5_(^+e)|y_y/|(y) (5.5) 

C [5(i,-+i) + (//+0)(ii -i,-+l)]nB5_(^+e)|y_y,|(y). 

Consider the case where Q < K-/4 so that 4(k:+ 0) < 5k-. If x' ,x" e B5/(x), where 5' = 
min(5, then 

„M / //, 5 25 5 

{K+e)\x'-x"\<-K—<-. 

Recalhng that ii = x' and iy = x" and applying ( I5.5l l repeatedly, we have 

5(y ) n /2 {y) c + (// + 0) (x' - x") . 

The above holds for all x',x" G B5/ (x) and for all > 0, and hence for 0=0, giving us the 
conclusion we need. □ 



This result gives a handle on the left hand bound. 

Lemma 5.4. ( On (I5.4ab ) Let S:W ^ be a closed set-valued map. Suppose 

where Si : R" =t M™, are closed set-valued maps such that for any e > andx 6 W, there 

is some I such that 

d{S{x),Si{x)) < e for alii > I. (5.6) 
Then for any 5 > and positive integer N, we have 

coD*5(x I y) C CO U U D*S.{x\y). 

i>N xeBg (.1) 
.ve»5(.v) 

Proof. By Lemma l278l we can prove that the following holds for all 5 > and positive 
integers instead; 



Jif{coD*S{x\y)) DJf 



\ 



coU U D*Siix\y) 

. i>N xeMg {x) 



Suppose // : R" ^ R" is a prefan in the RHS. Then for any / > and 5 > 0, 



H ejf 



\ 



CO y D*Si{x\y) 



xeBg(x) 



By Lemma |531 if 5' = min(5, 5|J]p) > then 

Si{x')nMs/2iy) C Si{x")+H{x' -x") for allx',x" e Ms^x). 
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For all S Ms'{x) and e > 0, we can find i large enough so that 

Six')nMs/2iy) c [Siix') + eM]nMs/2iy) 
C Si{x")+H{x' -x") + eM 
C S{x")+H{x -x")+2eW. 
The above holds for all £ > 0, and we have 

S{x')nns/2iy) cS{x")+H{x' ~x") foraliy,x" e]B5/(x). 
This implies that H e J^{coD*S{x \ y)) as needed. □ 

Remark 5.5. (On formula i5.6\ ) We note that conditions for d(5(x),5,(x)) < e were given 
in 0DL921 . and in particular, conditions for S{x) C + eB were given in IIMor061 The- 
orem 6.4] for example. 

Note that Theorem l4.1l savs thatD*5,(x | y){v) C Tli{x,y,v). To find suitable conditions 
for ( I5.4cl i. we need the following result. 

Lemma 5.6. (Convexification of intersection of nested sets) Suppose {A,}°1[ C M" are 
nested compact sets such that Ai^i CA,-. ThencoHiAi = n,CQA,-. 

Proof. Suppose x is in the LHS. Then x E coA, for all /, so x e n,coA,, establishing cofl, 

A; C n,C0A;. 

Next, suppose x is in the RHS. Then x e coA, for all i. Consider any v G K"\{0}. 
Since x G coA, , we have v^x < sup^,g^ v^a. By the compactness of A,-, let a, be such that 
v^di = sup^g^. v^a. Since DjAj C A,- for all it is clear that sup^^p,^^^ v^a < sup^^^. v^a for 
all /, so sup^i^^.^. v^a < inf,- sup^,g^. v^a. By the compactness of A,-, the limit a — limy^oo ay- 
exists and lies in DjAj. This shows that 

infsupy^fl = infv^a, 



< sup V^fl. 

aen jAj 

Then v^x < sup^^p,.^ . v^a, which holds for all v. Thus we have x G co n,A,, so coH, A,- = 
njCoA,- as needed. □ 

Here is a lemma useful for proving our next result. We take our result from IISmi021 
Lemma 4.4]. 

Lemma 5.7. ( Continuous solutions from discrete solutions) Assume that a set-valued map 
F : [0, r] X R" X — R" has closed convex values. Let the set-valued map {x^y) ^ 
F{t,x,y) be upper semicontinuous for almost all t G [0,T], and let F{t,x,y) C b{t)V> for 
all {t,x,y) G [0,r] X R" X W\ where b{-) G Li([0,r],R). Assume that functions Xk{-) G 
AC([0, T] , E"), ;t = 0, 1 , . . . , satisfy 

x[{t) ec6F{tMt),Vkit)«,n) + rikit)K, 

where TJ^. > 0, lim<;_!.oo = almost everywhere, and \ Tlk{t) \ < fj(f )> ^ — ^i'^t ■ ■> "ni') ^ 
Li([0,r],R). Then the functions xi^{-) are equicontinuous on [0,r]; and if a subsequence 
Xkp{') uniformly converges to a function x(-), then x{-) is a solution of the differential 
inclusion 

x'{t) eF{t,x{t),0)fort e [0,T] a.e. 
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Before we state our main result, we describe in detail the paths produced by discrete 
approximations in the remark below. 

Remark 5.8. (Discrete approximations) For {xij} o<j<i and {ptj} o<j<i , let At = T /i, and 
construct the following path x, : [0, T] M." defined by 

Xi{t) = ^•|^^ x,j+i + — ~^'J whenever t £ [jAt, {j + 1 )Af] , 

^ ^ t- jAt ( j + 1 )Af - f ^ ^ ^ , 

and pi{t) = pij+i H — pij whenever t G [jAt, (J + l)At\. 

It is clear that Xi{-) and /?,(•) are piecewise differentiable at all points other than integer 
multiples of Af , and the derivatives satisfy 

x'i{t) ~ i — jcjj) wheneverf e (y'Af, (j+ l)z^), (5.7a) 

and p-{t) = -^^{Pij+i -Pi.j) wheneverf e (jAf, (; + l)Af). (5.7b) 

We also need the following condition for Lemma |S!9l which was one of the conclusions 
in Theorem |4.2| 

e -D*Fk-,^N [x,_, I -xn)) (Pk) for all keTj7. (5.8) 

We now prove our result on ( I5.4cb . Note that (I5.4cl i represents a closedness property, 
and we shall show that Lemma lS^ provides some reasonable conditions for (I5.4cb to hold. 

Lemma 5.9. (On ( I5.4cl i) Suppose F : [Q-T] x R" ^ R" is a convex-valued osc function. 
Assume further that there is some b{-) G Li([0,r],R") such that coD*F{t,x \ y){p) C 
b{t)\\p\\M for all {t,x,y,p) e [0,T] x M" x R" x R". Suppose also that the following as- 
sumption holds: 

(1) Whenever {x,(-)}J^i and {pi{-)}f=i' constructed based on discrete approxima- 
tions {xi ;} o<j<i and {pi ;} o<j<i satisfying (I5.8l l as described in Remark \5.8\ sat- 

l</<oo ' l<,<oo 

isfies x,(0) — ?► X and Xi{T) y as N ^ 0°, then there exists a subsequence of 
{xi{')}T=i' '''^y {■''ik(')}k=i' ond x{-) G AC([0,r],R") such that 

• (•) converges uniformly to x{-), 

• x'j^{-) converges pointwise almost everywhere to x'{-), 

• x{-) satisfies the differential inclusion 

x{t) G F(t,x{t)) a.e., 
x{0) = X and x{T) = y, 

• and {Pij.(')}r=l converges uniformly to some p{-). 
Then we have 

n ciy y nKx,3',v) C n(i,y-y). (5.9) 



and Pi CO [J [J n,(x,y,v) C con(x,y,v). (5.10) 



A'gN.5>0 i>N xeBg{x) 
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Proof. First, we note that (15.91 ) implies ( 15.101 ). If ( 15.9b holds, then by Lemma |531 we have 

n coU U n,(x,y,v) = CO n clU U n,(x,y,v) 

A'gN,5>0 i>Af -veBg(.f) A'gN,5>0 i> A' .veB^ (.v) 

C con(x,3;,v). 

Proving (15. 9t is equivalent to proving the following: If m,- G n,(i,-,y,, v) and m, — ^ m, x, — ^ x 
and — > y as ; oo, then u G n(i:,y, v). Consider v G M" and the sequences of functions 
{^i{')}7=\ {Pi[')}T=\ constructed from o<j<i and {pij} o<j<i such that ji:,(0) ~ x;, 

I<;<oo I<'<™ 

x,(r) = yi, pi{0) — Ui and pi{T) — v. We therefore need to show that u G n(x,y, v). 
For a fixed t G [0, T], the map 

{p,x,y,p) ^ ~DlF{t.x{t) +x I x'(f ) +y) (/? + p) 

can be checked to be osc (at where x(f) and x'(f) are defined) from the definition of the 
coderivatives and the fact that the map {x^y) (-> A^Graph(f (r. )) i^ij) is osc. The map 

{p,x,y,p)^-CQDlF{t,x{t)+x\x;{t)+y){p + p) 

is osc since the convex hull operation preserves outer semicontinuity. (The proof is ele- 
mentary, and the steps are shown in |Panlla| for example.) 

Suppose x(-) is such that assumption (1) in the statement holds. Our problem can be 
solved if we can show that p{-) satisfies the differential inclusion 

p'(0G-coD:F(f,x(f)|x'(0)(/7(0). 
We try to find 7]^. : [0, T] [0,°o) such that for all t G [0, T], 

\im ^k{t):^Q (5.11) 

and p'i^ (f ) G -coDlF {t + Tj,(f )B,x(f ) + T7,(f )B | x\t) + T7,(f )B) (f ) + 77,(r)B) . 

For each t G [0,r] and k G T^, we have [f/(Af)J (Af) < t < \t|{^t) + IJ (Af), where 
Af = T and [aj is the greatest integer not more than a. For simplicity, we consider the 
case where t/T is irrational. From the definitions of x,^ (•) and (■) and (15.8b . we have 

P'kit) e -^DlF{tk,Xi^{tk)\x'i^{t)){p,^{tk + At)), 

where tj^ = [f/(Af)J (Af). To estabUsh the existence of Tji^(-) in (15.11b , it suffices to show 
that for each f , 

max{\tk~t\, \\xi^{tk) -x(f)||, ||x^f) -x'(f)||, ||p„(fi + Af) \0 as ^ 

We first have xj^ (f ) x'(f ) and f^. ^> f as A: — > oo. Next, since (■) converges uniformly to 
p{-), we have 

\\pi,{tk + At)-pi^{t)\\ 
< \\pi^iti, + At)-pitk + At)\\ + \\pitk + At)-pit)\\ + \\pit)-pi^it)\\, (5.12) 

(1) (2) (3) 

SO the term on the LHS converges to zero as k ^oo, A similar argument with x;^ (fj.) — x(f ) 
shows that its norm goes to zero as A; — oo. So the presence of Tji^(r) satisfying ( 15.11b is 
established. 

Since p{-) is continuous on the compact set [0,T], it is uniformly continuous. This 
implies that for any e > 0, we can find K such that term (2) in ( 15.12b has norm less than e for 
a\lk>K. The condition that 77^(0 < T] (f ) for all t G [0, T] for some T] (•) G Li ([0, T],W) (in 
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fact, Tj(-) e Loo([0,r],M")) follows easily. All the conditions for Lemma |5.7| are satisfied, 
and we have u e Tl{x,y, v) as needed. □ 

Though condition (1) may look more comphcated than ( I5.4cl ) alone, it can be under- 
stood as a measurability condition on x{-) and /?(•). We collect the previous results to 
obtain an estimate of the convexified limiting coderivative of the reachable map. 

Theorem 5.10. ( Convexified coderivative of reachable map) The formula ( 15.31 ) holds pro- 
vided: 

(a) For any £ >Q andx^W, there is some I such that A{R{x),Ri{x)) <£foralli> I. 

(b) For all X and t, F{t,-) is locally bounded at x. 

(c) There is some b{-) e Li ([0, T],W) such that \\DlF{t,x | y) 1|+ < b{t)forall {t,x,y) G 
[0, r] X M" X M". 

(d) Assumption (1) of Lemma \5.9\ holds. 

Proof. This combines Lemma \5A\ Theorem |4T| and Lemma [J!9l From (b) and (c), stan- 
dard methods of set-valued analysis imply that F{t,-) is locally Lipschitz, so the require- 
ments for Theorem |4. H are satisfied. The condition ||D*F(f,x | y)\\^ < b{t) is equivalent to 
the condition on coD*F{t,x \ y) in Lemma [S!9l □ 

Conditions (b) and (c) are typical assumptions for (EL), (TC) and (WP) to hold. Con- 
dition (a) is a mild assumption on how the discretized reachable map can approximate the 
continuous reachable map, and Condition (d) relates the discretized paths to continuous 
paths. The procedure of passing a sequence of discrete problems to the limit seems to 
make it unavoidable that assumption (d) has to hold, and that the conclusion can only be 
expressed in terms of convexified limiting coderivatives. The conditions (EL), (TC) and 
(WP) are usually proved with direct methods in analysis rather than through discrete ap- 
proximations, so it remains to be seen whether Theorem 15 . 1 01 can be further strengthened 
with such techniques. 

Remark 5.11. (Graph convex F(f, •)) The discrete case suggests that when F{t,-) is graph- 
ically convex for all f , then ( 15.2b is actually an equation. For the continuous case, we study 
( 15.3b instead, and ask whether ( 15.3b is an equation when F{t,-) is graphically convex for 
all t. In this case, (I5.4bl ) is an equation, but equality for ( I5.4ab requires further assump- 
tions. The reverse inclusion for ( I5.4cl ) holds if every continuous path on the RHS can be 
described as a limit of sequences on the left hand side. Such results may already be in 
the literature. We cite IISmi02i Theorem 4.16] for example, which states that the reverse 
inclusion in ( I5.4cb holds when F{-,-) is independent of its first argument t and is Lipschitz. 

6. Conclusion 

In this paper, we study how discrete and differential inclusions depend on the initial 
conditions. The advantage of such results over necessary optimality conditions is that such 
results give an indication of how to perturb the initial point to optimality. The results for 
discrete inclusions seem quite satisfactory, but the results for differential inclusions still 
require further improvement. 
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